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We discuss the conceptually different definitions used for the non-Markovianity of classical and 
quantum processes. The well-established definition for non-Markovianity of a classical stochastic 
process represents a condition on the Kolmogorov hierarchy of the n-point joint probability distribu- 
tions. Since this definition cannot be transferred to the quantum regime, quantum non-Markovianity 
has recently been defined and quantified in terms of the underlying quantum dynamical map, using 
either its divisibility properties or the behavior of the trace distance between pairs of initial states. 
Here, we investigate and compare these definitions and their relations to the classical notion of 
non-Markovianity by employing a large class of non-Markovian processes, known as semi-Markov 
processes, which admit a natural extension to the quantum case. A number of specific physical 
examples is constructed which allow to study the basic features of the classical and the quantum 
definitions and to evaluate explicitly the measures for quantum non-Markovianity. Our results 
clearly demonstrate several fundamental distinctions between the classical and the quantum notion 
of non-Markovianity, as well as between the various quantum measures for non-Markovianity. 
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I. INTRODUCTION 

A lot of effort has been put into the study and under- 
standing of non-Markovian effects and dynamics within 
the description of open quantum systems [l| . These ef- 
forts have faced quite a huge amount of difficulties arising 
both because of practical as well as fundamental reasons. 
Indeed, on the one hand the treatment of non-Markovian 
systems is especially demanding because one cannot rely 
on simplifying assumptions such as weak coupling, sep- 
aration of time scales between system and environment, 
and the factorization of the system-environment state. 
On the other hand, in the non-Markovian case there is 
no general characterization of the equations of motion, 
such as in the Markovian setting thanks to the theory 
of quantum dynamical semigroups, and the very notion 
of non-Markovianity in the quantum case still has to be 
cleared up. In the last few years this topic has experi- 
enced a significant revival, leading to important improve- 
ments and to the deeper understanding of quite a few 
issues in the theory of open quantum systems (see e.g. 
and references therein). 

Apart from the explicit detailed treatment of many 
specific quantum systems where memory effects show up, 
efforts have been made to obtain general classes of non- 
Markovian equations leading to well-defined completely 
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positive time evolutions [!, [l(| ■ At the same time ad- 
vances have been made in order to actually define what 
is meant by a non-Markovian quantum dynamics [TlT - 
Ojl . This work has raised all sorts of questions regarding 
the connection among the different approaches, as well as 
the relationship between the notion of non-Markovianity 
used in classical and quantum setting, together with the 
quest for clearcut signatures of non-Markovian behavior. 

The present paper is devoted to address some of these 
questions, focussing in particular on the connection be- 
tween the very definition of non-Markovian process used 
in classical probability theory, and the Markovian or non- 
Markovian behavior in the dynamics of a physical system. 
It will naturally appear that these two notions are quite 
different. Starting within the classical framework, we will 
analyze how the non-Markovianity of a process reflects it- 
self in the behavior of its one-point probability density, 
which naturally leads to criteria for the characterization 
of non-Markovian behavior in the dynamics. These cri- 
teria can be extended to the quantum setting, thus pro- 
viding natural tools to assess the non-Markovianity of a 
quantum time evolution. They are based on the possibil- 
ity to connect the probability vectors giving the state of 
the system at different times through well defined tran- 
sition matrices, and to the behavior of solutions corre- 
sponding to different initial states with respect to the 
Kolmogorov distance. 

Despite the abstract framework, the whole presenta- 
tion is built with reference to explicit examples. These 
examples find their common root in being related to real- 
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izations of a class of non-Markovian processes for which, 
as an exceptional case, an explicit characterization is 
available, namely semi-Markov processes. This approach 
will enable us to construct different non trivial dynamics 
both in the classical and the quantum case, showing quite 
different behaviors and amenable to an explicit analysis, 
both in terms of the previously introduced criteria and 
of the recently proposed measures of non-Markovianity, 
thus allowing for a concrete comparison of these mea- 
sures. 

The paper is organized as follows. In Sect. |TT]we in- 
troduce the notion of classical and quantum map for the 
dynamics of an open system, introducing the notions of 
P-divisibility and CP-divisibility which will turn out to 
be useful in order to compare different behaviors. In 
Sect. IIIII we recall the notion of non-Markovianity for a 
classical process, showing its relation to the behavior of 
the one-point probability density. We further consider 
examples of classical semi-Markov processes character- 
ized by different stochastic matrices and waiting time 
distributions, studying their P-divisibility and the behav- 
ior with respect to the Kolmogorov distance. In Sect. IIVI 
we perform a similar analysis in the quantum setting, 
considering classes of dynamics which can be related to 
semi-Markov processes. These dynamics still allow for an 
exact determination of their divisibility properties and of 
their quantum measure of non-Markovianity according to 
the recent proposals. In particular we provide exact ex- 
pressions for the values of these measures, thus allowing 
for their explicit comparison. We further comment on 
our results in Sect. [V] 

II. DYNAMICAL MAPS 

If the initial state of system and environment factor- 
izes, the dynamics of an open quantum system can be de- 
scribed by a trace preserving completely positive (CPT) 
map, so that the state of the system p (t) evolving from 
an initial state p (to) is given by 

p(t) = $(t,t )p(t ). (I) 

The most general structure of such time evolution maps 
is not known, apart from the important subclass of maps 
which obey a semigroup composition l aw, which can be 
characterized via a suitable generator [lj, [l5| . In order 
to characterize and actually define Markovianity or non- 
Markovianity in this setting one can follow essentially two 
approaches: either one assumes that the map $ (f, to) is 
known, and therefore relys on looking at certain mathe- 
matical properties of the map itself, which is essentially 
the path followed in different ways in [ill or onc 
studies the behavior in time of the solutions p (t) allow- 
ing the initial condition to vary over the possible set of 
states, which is the approach elaborated in [l2|, [l6j] rely- 
ing on a suitable notion of distinguishability of quantum 
states [l7j , an approach which captures the idea of infor- 
mation flow between system and environment. Note that 



Markovianity or non-Markovianity should be a property 
of the map or equivalently of the time evolved states, 
not of the equations admitting such states as solutions. 
Indeed quite different form of the equations, e.g. inte- 
grodifferential or local in time, might admit the very 
same solutions, as we shall also see in the examples in 
Sect. IIVI Of course, since in a concrete physical setting 
one is rather faced with the equations of motion rather 
than with their general solution, it is therefore also of 
great interest to assess possible links between the equa- 
tions themselves and the Markovian or non-Markovian 
behavior of their solutions. 

To better understand and compare these two ap- 
proaches, besides the notion of complete positivity and 
trace preservation other finer characterizations of the 
time evolution map $ (£, 0) turn out to be useful, where 
we have set for the sake of simplicity to = 0. If the map 
$ (t, 0) can be split according to 

$ (t, 0) = $ (t, s) $ (s, 0) (2) 

for any t ^ s ^ 0, with $ (t, s) itself a CPT map, we 
say that the map $ (t, 0) is CP-divisible, which implies 
that $ (t, s) is itself a well-defined time evolution having 
as domain the whole set of states. Note that at variance 
with Ref. [ill focussing on quantum channels, the notion 
of divisibility considered here refers to families of time 
dependent dynamical maps. The existence of $ (t, s) as 
a linear map is granted if $ (s, 0) is invertible, which is 
typically the case away from isolated points of time, so 
that 

$(M) = $(i,0)$ _1 (s,0). (3) 

The existence of $ (t, s) as a linear map, however, docs 
not entail its complete positivity. Indeed, we will say 
that the map $ (t, 0) is P-divisible if $ (t, s) send states 
into states but is only positive, and that it is indivisible if 
neither P-divisibility nor CP-divisibility hold. Examples 
of such maps together with their physical interpretation 
will be provided in Sect. IIVI 

The notion of P-divisibility can be considered also in 
the classical setting. Suppose to consider a finite dimen- 
sional classical system, described by a probability vector 
p (t). Its time evolution can be described by a time de- 
pendent collection of stochastic matrices A (t, 0) accord- 
ing to 

p(t)=A(f,0)p(0). (4) 

Similarly as before, we say that the classical map A (t, 0) 
is P-divisible provided for any t ^ s ^ one can write 

A(t,0) = A(t,*)A(*,0), (5) 

where each of the A (t, s) is itself a stochastic matrix. 
Its matrix elements satisfy therefore (A(t, s))^ and 
J2k (A (t, s)) k j = 1, which provide the necessary and suf- 
ficient conditions ensuring that probability vectors are 
sent into probability vectors [l{|. Once again this need 
not generally be true, even if the map A (s, 0) is invertible 
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as linear operator. Note that we are here only consider- 
ing the one-point probabilities p (t) , which are certainly 
not enough to assess Markovianity or non-Markovianity 
of a process according to the mathematically precise def- 
inition used in classical probability theory. 



III. CLASSICAL NON-MARKOVIAN 
PROCESSES 

Let us now recall what is the very definition of non- 
Markovian process in the classical probabilistic setting. 
Indeed the analysis of classicalprocesses is a natural 
starting point, also adopted in [2CH24I ]. Suppose we are 
considering a stochastic process taking values in a numer- 
able set {xi} ie¥S . The process is said to be Markovian if 
the conditional transition probabilities satisfy 

Pl\n {Xn : tn \Xn— 1 3 ^n— 1 1 • ■ • 7 -^0 j ^0) 

(x n ,t n \%n-l,tn-l) (6) 

with t n ^ i n -i ^ • • • ti ^ to, so that the probability 
that the random variable assumes the value x n at time 
t n , given that it has assumed given values Xi at previous 
times U, actually only depends on the last assumed value, 
and not on previous ones. In this sense the process is said 
to lack memory. This statement obviously involves all n- 
times probabilities, so that the non-Markovianity of the 
process cannot be assessed by looking at the one-time 
probabilities only [25l . [26j . It immediately appears from 
Eq. ((6]) that such a definition cannot be transferred to 
the quantum realm, since the very notion of conditional 
probability does depend on the measurement performed 
in order to ascertain the previous value of the random 
variable, and on how it transforms the state for the sub- 
sequent time evolution. 

If we know that the process is Markovian the n-point 
probabilities can be easily obtained in terms of the initial 
probability density and the conditional transition proba- 
bility according to 

Pn {Xn , t n , X n — \ , t n — 1 , . . . , Xq , £()) — 

n 

~\_Pi\i [xi.t^Xi-i^i^pi (x ,t ) ■ (7) 
1=1 

The Markov condition Eq. ([5]) in turn implies that 
the conditional transition probability pin obeys the 
Chapman-Kolmogorov equation 

Pi\i(x,t\y,s) = ^2p lll (x,t\z,T)p lll (z,r\y,s) , (8) 

z 

with t ^ r ^ s, whose possible solutions characterize the 
transition probabilities of a Markov process. A Markov 
process is therefore uniquely characterized by its condi- 
tional transition probability and the initial distribution. 

If p (t) denotes the vector giving the one-point proba- 
bility of a Markov process taking values in a finite space, 



and if A (t, s) is its conditional transition probability ex- 
pressed in matrix form, the probability vectors at differ- 
ent times are related according to 



p{t) = A(t,s)p{s) 



(9) 



with t ^ s ^ and A (t, s) a stochastic matrix obeying 
the Chapman-Kolmogorov equation, which in this case is 
equivalent to the requirement of P-divisibility in the sense 
of Eq. ([5]). However, in general validity of the Chapman- 
Kolmogorov equation and P-divisibility obviously do not 
coincide, since the P-divisibility does not tell anything 
about the higher-point conditional probabilities. Indeed, 
for a given process one might find a matrix A (t, s) satisfy- 
ing Eq. (J9j) even if the process is non-Mar kovian, however 
in this case the matrix is not the conditional transition 
probability of the process [13, HI] . Similarly to Eq. , 
if A (i, 0) is invertible one can obtain such a matrix as 



A(i,s) = A(t,0)A" 1 (s,0) : 



(10) 



which warrants independence from the initial probability 
vector. On the contrary, the conditional transition prob- 
ability of a non-Markovi an p rocess does depend on the 
initial probability vector 27). 



A. Classical semi-Markov processes 

To spell out this situation in detail let us consider an 
example. The main difficulty lies in the fact that gen- 
erally very little is known on non-Markovian processes. 
We will however consider a class of non-Markovian pro- 
cesses allowing for a compact characterization, that is to 
say semi-Markov processes [1^] . To this end we consider 
a system having a finite set of states, which can jump 
from one state to the other according to certain jump 
probabilities 7r m „, waiting a random time in each state 
before jumping to the next. Such a process turns out to 
be Markovian if and only if the waiting time distributions 
/„ (t) characterizing the random sojourn time spent in 
each state are given by exponential probability distribu- 
tions, and non-Markovian otherwise. Each such process 
is fixed by its semi-Markov matrix 



(Q)mn W 



Jn (r) 



(11) 



where the 7r TOn are the elements of a stochastic matrix. 
Assuming for the sake of simplicity a two-dimensional 
system, a site independent waiting time distribution and 
the stochastic matrix to be actually bistochastic [l!| , the 
semi-Markov matrix is determined according to 



(t) = 



1 — 7T 7T 
7T 1 — 7T 



f(r). 



n/(r) 



(12) 



with 7r a positive number between zero and one giving the 
probability to jump from one site to the other, and / (t) 
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an arbitrary waiting time distribution with associated 
survival probability 



g(t) = l- / dr/(r) 
Jo 



(13) 



B. Transition probability 

The transition probability for such a process can be de- 
termined exploiting the fact that it is known to obey the 
following integrodiffcrcntial Kolmogorov forward equa- 
tion 



31] 



^T(t,0) = J drW (t)T 



(t-T,0). 



here expressed in matrix form with 

W (r) = (n - 1) k (r) 



(14) 



(15) 



where the memory kernel k (r) relates waiting time dis- 
tribution and survival probability according to 



f(r) 



dtk (r-t)g (t) 



(16) 



Denoting by v (u) the Laplace transform of a function or 
matrix v (r) according to 



r+oo 

v(u) = / drv(T)e- UT , 
Jo 



(17) 



the solution of this equation with initial condition 
T (0, 0) = 1 can be expressed as 



Tin) 



n/(«) 



(18) 



C. Explicit examples 

The explicit solution of Eq. (|18[) for tt = 1/2, so that 
at each step the system has equal probability to remain 
in the same site or change, is given by 

Tit 0)--( 1+5(<) 1 ~9(f)\ (19) 
ft) 2il-j(t) 1+9®)' [ ] 

so that according to Eq. (fTT)|) we can introduce the ma- 
trices 



T(t,s) = T(t,0)T~ 1 (s,0) 

_ 1 fl + g(t)/g(s) l-g(t)/g(s) 



2 \l-g(t)/g(s) l+g(t)/g(s) 



,(20) 



which indeed connect the probability vectors at different 
times according to 



p(t)=T(t,s)p(s) 



(21) 



Given the fact that for any non vanishing waiting time 
distribution the survival probability is a strictly posi- 
tive monotonic decreasing function, the matrices T (t, s) 



are well-defined stochastic matrices for any pair of times 
t ^ s, so that the classical map T (t, 0) is always P- 
divisible, irrespective of the fact that the underlying pro- 
cess is Markovian only for the special choice of an expo- 
nential waiting time distribution of the form 



/ (r) = Ac 



-At 



(22) 



This result implies that the one-point probabilities of the 
considered non-Markovian semi-Markov process can be 
equally well obtained from a Markov process with con- 
ditional transition probability pi\i given by T, whose n- 
point probabilities can be obtained as in Eq. ([7]). The 
latter would however differ from those of the considered 
semi-Markov process. 

As a complementary situation, let us consider the case 
7T = 1, so that once in a state the system jumps with 
certainty to the other, thus obtaining as explicit solution 
of Eq. (|18p the expression 



T{t,0) 



lit) 
•?(*) 



(23) 



and therefore 



T(t,s) =T(t,0) T- 1 (s,0) 

= 1 fl + q(t)/q(8) l-q(t)/q( S ) 
2 \l-q(t)/q(s) l + q(t)/q(s) 



(24) 



The quantity q (t) appearing in these matrices is the in- 
verse Laplace transform of the function 



l l-/(u) 
q (u) = . 

«! + /(«) 



(25) 



Recalling that the probability for n jumps in a time t for 
a waiting time distribution / (t) is given by 



so that 



one has 



Pn(t)= drf(t-T)p n -i (t) 
Jo 



p n (u) = po (u) f n (u) . 



(26) 



(27) 



?(t) = ^P2„(t)-^P2n+l(*) (28) 
71=0 n=0 

= Pevon (t) - Podd (t) ■ 

The quantity q (t) therefore expresses the difference be- 
tween the probability to have an even or an odd number 
of jumps. At variance with the previous situation, the 
quantity q (t) depending on the waiting time distribu- 
tion can assume quite different behavior, showing oscil- 
lations and going through zero at isolated time points, 
so that at these time points, corresponding to a crossing 
of trajectories starting from different initial conditions, 
the transition matrix T (t,s) is not defined. Moreover 
due to the non monotonicity of q (t) the matrices T (t, s) 
cannot always be interpreted as stochastic matrices. Of 
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course in the Markovian case, corresponding to Eq. ([22]) 
and therefore to q (t) = exp (— 2Xt), all these features are 
recovered. 

The variety of possible behaviour is best clarified by 
considering explicit expressions for the waiting time dis- 
tribution / (t) which determines the process once the 
stochastic matrix II is given. Quite general expressions 
of waiting time distribution can be obtained by consider- 
ing convex mixtures or convolutions of exponential wait- 
ing time distributions with equal or different parameters, 
whose Laplace transform is given by rational functions 
[32l [lU . To better understand the dynamics generated 
by the maps Eq. (fl~9|) and Eq. ([23]) in the following exam- 
ples note that for it — 1/2 the matrix II is idempotent, 
sending each probability vector to the uniform distribu- 
tion, while for it = 1 one has H 2n = 1, and the action 
of the bistochastic matrix consists in swapping the two 
elements of the probability vector. 



1. Convolution of exponential waiting time distributions 

The behavior of the quantity q (t) can be explicitly 
assessed for the case of a waiting time distribution f (t) 
given by the convolution of two exponential waiting time 
distributions. Let us first consider the case in which the 
waiting time distributions share the same parameter A, 
so that f = / * / with / as in Eq. (|2"2"j) , corresponding to 



f (*) = X 2 tc 



-At 



and therefore 



= (1 + At)e 



-At 



This is a special case of the Erlang distribution [32 
ing to 



-XI 



cos (Xt) + sin (Xt)] , 



(29) 

(30) 
lead- 

(31) 



which oscillates and crosses zero at isolated points, so 
that the matrices T (t, s) are not defined at these points 
and cannot be always interpreted as stochastic matrices, 
since their entries can become negative. This behavior 
is exhibited in Fig. [TJ where the quantity Eq. (f3~Tj) is 
plotted together with the trajectories of the probability 
vector with different initial conditions. We also consider 
the behavior of g (t) and of the trajectories for the same 
waiting time distribution but a semi-Markov process with 
stochastic matrix fixed by it = 1/2. The probability vec- 
tor is of the form 



P(t) 



w(t) 
-w(t) 



(32) 



so that its trajectories are displayed showing w (£), where 
w(t)= l -[l-q(t) + 2q{t)w{0)] (33) 



or 




FIG. 1. (Color online) (top) Plot of the function q (dashed 
line) given by Eq. (|28[) as a function of Xt for the convolution 
of two equal exponential waiting time distributions, for the 
case of a semi-Markov process with tt = 1, together with a 
few trajectories (continuous lines) for the upper element w (t) 
of the one-point probability according to Eq. (|32|l . The initial 
data w (0) are uniformly taken between and 1. When q (t) 
goes through zero the trajectories cross. At these points \q (t)\ 
starts growing, which indicates the failure of P-divisibility of 
the time evolution as defined in Eq. ([5|. (bottom) Plot of the 
function g given by Eq. (|13[) as a function of Xt, for the same 
waiting time distribution, together with a few trajectories, 
corresponding to a semi-Markov process with n — 1/2. As it 
appears, despite sharing the same waiting time distribution 
the trajectories for this semi-Markov process never cross, and 
P-divisibility holds even if the process is non-Markovian. 



in the two cases it = 1 and tt = 1/2 respectively. Note 
how for tt = 1 the different trajectories tend to group 
together and then separate again depending on the be- 
haviour of q(t). A more general situation is given by 
f = /1 * /aj where each fi is of the form Eq. (f22j) with 
parameter Ai, so that one has 



f(t) 



2^e" 



^4sinh 



st 



and correspondingly 



w(t) = -[l-g(t)+2g(t)«,(0)] (34) 



;(*) = e" 



(35) 



(36) 
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where we have set 



s 
P 



Ai + A 2 
Ai A2 



1-4- 



(37) 



The function q (t) determining the matrices T (t, s) is now 
given by 



Cosh 



st 



-x 



1 



Sinh 



st 



with 



1-8- 



2 ' 



(38) 



(39) 



The expression given by Eq. (j38j) shows an oscillatory 
behaviour if \ becomes imaginary, for 3— 2v2 A1/A2 
1/ (3 - 2 V2) , while it is a positive monotonic function of 
t otherwise. The latter situation is considered in Fig. [2] 



2. Mixture of exponential waiting time distributions 

For the case of a convex mixture of two exponential 
distributions on the contrary the trajectories never cross, 
and the matrices T (t, s) always are well-defined stochas- 
tic matrices. Indeed this can be seen from 



f(i) = /i/ 1 (t) + (l-/i)/ 2 (t), 
with ^ fj, ^ 1, so that 

g (i) = M e- Alt + (l- M )e- A2i 

and 



?(*) 



with 



3 -!(Ai+A 2 +(A»t 



(40) 
(41) 
(42) 



Cosh 



(A 1+ A 2 -3(A)) 



Sinh 



(A) = fxXi + (1 - fx) A 2 
the mean rate and 



A= V(Ai+A 2 + (A)) z -8AiA 2 



(43) 



(44) 



This case is considered in Fig. [3] 

It should be noticed that in all these situations the 
process is non-Markovian, but P-divisibility of the time 
evolution A (t, 0) in the sense of Eq. ([5]) still holds in some 
cases. For a semi-Markov process with semi-Markov ma- 
trix as in Eq. (fT2f and ir = 1/2, P-divisibility always 
holds, in particular as shown in the examples the trajec- 
tories never cross and \q(t)\ never grows. For n = 1 on 
the contrary the behaviour depends on the waiting time 
distribution, which determines whether or not the quan- 
tity q (t) shows an oscillating behavior, implying that the 
trajectories start getting closer till they cross and then 
get apart once again. 
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FIG. 2. (Color online) (top) Plot of the function q (t) (dashed 
line) and of the trajectories (continuous lines) as in Fig.[T] but 
for the convolution of two different exponential waiting time 
distributions. We plot q as a function of st, taking p/s 2 = 
0.12, with s and p sum and product of the two parameters 
characterizing the exponential waiting time distributions as 
in Eq. (|37[) . For this case the quantity \ given by Eq. (|39|) 
is positive, ensuring monotonicity of q(t). (bottom) Plot of 
g (t) and the corresponding trajectories for the same waiting 
time distribution. 



D. Kolmogorov distance 



It is interesting to relate this behavior to the time 
dependence of the Kolmogorov distance among proba- 
bility distributions arising from different initial states. 
The Kolmogorov distance between two probability vec- 
tors can be written as Kia 



Dk (P 1 (t) ,p 2 (t)) = \ £ \p\ {t)-pf (t)\ . (45) 



If the map A (t, 0) is P-divisible in the sense of Eq. (|5|), 
then the Kolmogorov distance is a monotonic decreasing 
function of time. Indeed by the two basic properties of 
a stochastic matrix, the positivity of its entries and the 



7 




FIG. 3. (Color online) (top) Plot of q (t) (dashed line) and the 
trajectories (continuous lines) as in Fig. [TJ but for the convex 
mixture of two different exponential waiting time distribu- 
tions. We plot q function of Xt, taking Ai = aiA and 
A2 = e^A, with ai = .1 and ai = .2, together with mixing pa- 
rameter (i = 0.3. (bottom) Plot of g (t) and the corresponding 
trajectories for the same waiting time distribution. 



fact that each row sum up to one, one has for t s ^ 



D K (p l (t), P 2 W) = ^E 



5>(t,*) ifc Op 1 (s)-p 2 (s)) 

k 

i k 

= \H\^^-p 2 ^)) k \ 

k 

= D K (p 1 (s) ,p 2 (s)) . (46) 

This holds true independently of the fact that the un- 
derlying classical process is Markovian or not, it only 
depends on the fact the one-point probabilities can be 
related at different times via stochastic matrices. 

In a generic non-Markovian situation the Kolmogorov 
distance can both show a monotonic decreasing behavior 
as well as revivals. Indeed, focusing on the examples 
considered above, for a semi-Markov matrix as in Eq. (|12p 
and 7r = 1/2 one has 

Dk {p 1 (f) , P 2 (t)) = g (t) D K (p 1 (0) ,p 2 (0)) , (47) 



while for 7r = 1 one has 

D K (p 1 (t) ,p 2 (f)) =\q(t)\D K (p 1 (0) ,p 2 (0)) . (48) 

Thus, while for it = 1/2 the Kolmogorov distance is a 
monotonic contraction for any waiting time distribution, 
thanks to the fact that g (t) is a survival probability, for 
7r = 1 the distance among distributions can show revivals 
depending on the explicit expression of q (t) , as can be 
seen from Fig. [1] for the case of the convolution of two 
exponential waiting time distributions with the same pa- 
rameter. 

We have thus studied, by means of explicit examples, 
the behavior of the probability vector or one-point prob- 
ability p (t) of a classical process. In particular, we have 
seen that while for a Markovian process P-divisibility is 
always granted and the Kolmogorov distance is a mono- 
tone contraction, non-Markovianity can spoil these fea- 
tures, even though neither the lack of P-divisibility nor 
the growth of the Kolmogorov distance can be taken as 
necessary signatures of non-Markovianity. This is not 
surprising due to the fact that the non-Markovianity of 
a classical process cannot be traced back to the behavior 
of the one-point probabilities, since it involves all n-point 
probabilities. 



IV. QUANTUM NON-MARKOVIAN 
PROCESSES 



We now come back to the quantum realm, studying a 
class of quantum dynamics which have a clearcut phys- 
ical meaning, allowing both for the evaluation and the 
comparison of two recently introduced measures of non- 
Markovianity for the quantum case, and for a direct con- 
nection with the classical situation analyzed in Sect. IIIII 
Indeed, while in the classical case one has a well set- 
tled definition of non-Markovianity for a stochastic pro- 
cess, which can be used to speak of Markovianity or 
non-Markovianity of the time evolution of the associated 
probability distributions, equivalent characterizations for 
the quantum case have been proposed only recently. As 
follows from the discussion in Sect. IIIII such approaches 
cope by necessity with the behavior of the one-point 
probabilities only, which can be obtained from the statis- 
tical operator p (t) , since a definition involving the whole 
hierarchy of n-point probabilities cannot be introduced 
without explicit reference to a particular choice of mea- 
surement scheme. Note that in the study of quantum dy- 
namics one speaks about measures of non-Markovianity, 
since apart from clarifying what is the signature of non- 
Markovianity, so as to define it and therefore make it 
detectable, one would like to quantify the degree of non- 
Markovianity of a given dynamics. 

The two measures that we will consider here [lU, [l3| 
actually respectively rely on the violation of the quan- 
tum analog of the classical properties of P-divisibility and 
monotonic decrease in time of the Kolmogorov distance, 
that we have considered in Sect. IIIII and hold true for the 
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Markovian case, while also other approaches have been 
considered [ll[. Note that the violation of these prop- 
erties in the classical case provide a sufficient but not 
necessary condition to detect a non-Markovian process, 
as clarified in the examples considered in Sect. MI Al 



A. Quantum semi-Markov processes 

As in the classical case, in order to study the Marko- 
vian or non-Markovian features of a quantum dynam- 
ics we consider a class of time evolutions which allow 
for an explicit treatment and the connection to a classi- 
cal counterpart. Let us study dynamics given by master 
equations of the form [lj| 



drk (t -t)[£ -l]p (r) 



(49) 



where £ is a CPT map and k (t) a memory kernel as- 
sociated to a waiting time distribution / (t) according to 
Eq. (|T6| . Such master equations generate by construction 
completely positive dynamics, which provide a quantum 
counterpart of classical semi-Markov processes 0, [30j . 
Indeed, as it can be checked, the solution of Eq. (|49[) can 
be written as 



p(t) = $(t,0)p(0) 

oo 

= 5>„(t)£>(0). 



(50) 



n=0 



with p n (t) fixed by / (t) according to Eq. ([26]), while £ n 
denotes the n-fold composition of the map £. The map 
<$> (t, 0) is thus completely positive by construction and 
can be interpreted as the repeated action of the CPT 
map £, implementing a quantum operation, distributed 
in time according to the waiting time distribution / (t). 
For the case of an exponential waiting time distribution 
the memory kernel is a delta function and one goes back 
to a semigroup dynamics. In Scct. lIIll we considered semi- 
Markov processes with a semi-Markov matrix of the form 
Eq. ([T^]), with arbitrary f (t) and II a bistochastic ma- 
trix, and where Markovianity or non-Markovianity of the 
process depended only on the choice of / (t) , while P- 
divisibility and behavior of the Kolmogorov distance did 
depend on both / (t) and IT. In the quantum setting we 
also leave / (t) arbitrary and consider bistochastic CPT 
maps, in the sense that £ [1] =1, so that also $ (t, 0) is 
bistochastic, preserving both the trace and the identity. 



B. Dephasing dynamics and time-local equation 



which satisfies £ 2ra = 1 and £ 2n+1 = £ z , so that one has 

P (t) = Pcvcn (t) p (0) - p dd (*) &zP (0) <J Z (52) 

p u (0) q(t)p 10 (0) 
q(t)p 01 (0) p O o(0) 



recalling the definition Eq. (|28p of q (t) and consider- 
ing matrix elements in the basis of eigenvectors of a z . 
Before addressing the issue of characterization of these 
dynamics, it is of interest to recast the intcgrodiffcrcn- 
tial master equation Eq. (|49p in a time-convolutionless 
form. Indeed, while Markovianity or non-Markovianity is 
a property of the solution p (t) , rather then of the equa- 
tion, it is quite important to read the signatures of a 
non-Markovian behavior from the equations themselves, 
and this task turns out to be much easier when the equa- 
tions are written in time-local form. To rewrite the mas- 
ter equation Eq. (|4"9"]l in time-local form we follow the 
constructive approach used in [36j]. We thus obtain the 
time-convolutionless generator, which is formally given 
by (t, 0) (t, 0), by a representation of the map as a 
matrix with respect to a suitable operator basis in (D 2 , 



given by {X t } - 
cording to Tr s {XiXj} 



orthonormal ac- 

i=l,2,3 

jjj. The matrix F = (Fki) 
associated to the map $ is then determined as 



v/2 
5 



F kl = Tr. 



{xl*[x t ]} 



so that 



^[p)=J2 F ki r ^s{x}p}x k . 



The matrix F for our map is given by 

F(t,0) = diag(l, g (t), q(t),l) 



(53) 



and accordingly the time-convolutionless master equa- 
tion simply reads 



-p(t)= 1 {t)C z [p(t)], 



(54) 



where we have a single quantum channel given by 

C z [p] = a z pa z - p (55) 
and the time dependent rate 7 (t) is 



2q{t) 



(56) 



Id, 

log k ML 



A purely quantum dynamics, only affecting coherences, 
is obtained considering the CPT map 



£ Z P = cr 2 pcr 2 , 



(51) 



1. Divisibility 

Relying on the matrix representation of the map 
$ (t, 0) given by Eq. (|53|) we are now in the position to 
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study its divisibility according to Eq. ([2]). In particu- 
lar the map $ (t, 0) will turn out to be P-divisible if the 
matrices 



F (t, s) = diag 



1 q(t) q(t) 
' q(s)' q (s) ' 



(57) 



obtained as in Eq. ([3]) represent a positive map $ (t, s) 
for any t ^ s ^ 0, which is the case provided 



?(*) 



3 00 



^ 1. 



(58) 



This condition is satisfied if \q (f)| is a monotonic decreas- 
ing function, and therefore the time dependent rate 7 (t) 
is always positive. In order to assess when CP-divisibility 
holds, one can consider positivity of the associated Choi 
matrix [37| , which still leads to the constraint ([55)1 . It fol- 
lows that for this model CP-divisibility and P-divisibility 
are violated at the same time, whenever \q (t)\ increases, 
so that 7 (t) becomes negative. Thus, as discussed in [l6j |. 
for the case of a single quantum channel positivity of the 
time dependent rate ensures CP-divisibility of the time 
evolution, which is violated if 7 (t) becomes negative at 
some point. 



2. Measures of non- Markovianity 

We can now evaluate the measures of non- 
Markovianity for this model according to both ap- 
proaches devised in [l2j and in [l3j . 

The first approach by Breuer, Laine and Piilo relies on 
the study of the behavior in time of the trace distance 
among different initial states. The trace distance among 
quantum states quantifies their distinguishability |34ll35j |. 
and is defined in terms of their distance with respect to 
the trace class norm, thus providing the natural quantum 
analog of the Kolmogorov distance 

D(p 1 (t),p 2 (t))=±\\p 1 (t)-p 2 (t)\\ 1 . (59) 
For our case it reads 



D (p 1 (i) , p 2 (t)) = ^/A„(0) 2 + |A c (0)| 2 9 2 (i), (60) 
where we have set 



A p (0) = p\ x (0) - p 2 (0) 
Ac (0) = p\ Q (0) - p 2 w (0) 



(61) 
(62) 



for the differences of the populations and the coherences 
between two given initial states p 1 (0) and p 2 (0) respec- 
tively. Its time derivative is then given by 



a(t,p^ (0)) 



\A r 



^A p (0) 2 + |A c (0)|V (t) 



q(t)q(t) 



(63) 

so that the trace distance among states can indeed grow 
provided q (t) and q (t) have the same sign, so that \q (t)\ 



does increase. Thus the map has a positive measure of 
non-Markovianity whenever P-divisibility or equivalently 
CP-divisibility is broken. 

In order to obtain the measure of non-Markovianity for 
this time evolution according to [HI one has to integrate 
the quantity a (t, p 1 ' 2 (0)) over the time region, let us call 
it where it is positive, and then maximize the result 
over all possible initial pairs of states. The region f2 + now 
corresponds to the time intervals where \q(t)\ increases, 
and the maximum is obtained for initial states such that 
A p (0) = and A c (0) = 1, so that we have the following 
explicit expression for the measure of non-Markovianity 



Af($) 



dt-\q(t)\ 
n + at 



(64) 



£>(&i)|-|9(aOI), 



where we have set il + = [J i (a,i,bi). A couple of states 
which maximize the growth of the trace distance is given 
in this case by the pure states p 1 ' 2 (0) = \ip±}('ip±\, with 
|V ± ) = (1A/2)(|0>±|1». 

The approach by Rivas, Huelga and Plenio instead fo- 
cuses on the CP-divisibility of the map. While for this 
model this requirement for non-Markovianity is satisfied 
at the same time as the growth of the trace distance, 
the effect is quantified in a different way. Indeed these 
authors quantify non-Markovianity as the integral 



!($)= / d* fl (t) 

where the quantity q (t) is given by 

1| |$choi(i,t + e)||i -1 



fl (t) = lim 



(65) 



(66) 



where 'I'choi denotes the Choi matrix associated to the 
map and it is different from zero only when CP- 
divisibility is broken. For the case at hand one has 



J(*) = J d<-log|q(t)| (67) 

= 5^ (log | ff (60| - log Iff (o<)|) 
d*y(*). 

For this model the growth of \q(t)\ determines both 
the breaking of CP-divisibility as well as the growth of 
the trace distance, so that both approaches detect non- 
Markovianity at the same time, even if they quantify it 
in different ways. This is however not generally true, 
as observed already in [l6j] and considered in [22], [3c| . 
We will point to examples for the different performance 
of the two measures later on. Exploiting the results of 
Sect. lIII Al it is now interesting to consider explicit choices 
of waiting time distributions, so as to clarify the different 
possible behaviors. 
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FIG. 4. (Color online) Plot of q (red dashed line), 7 (green 
dot-dashed line) and S (blue continuous line) defined in 
Eq. ((28)) . Eq. ((56)) and Eq. ((84)) respectively, as functions of Xt 
for the convolution of two equal exponential waiting time dis- 
tributions. The vertical asymptotes denote the points where 
q (t) goes through zero, so that 7 (t) diverges. The functions 
7 (t) and 5 (t) appear as time dependent coefficients in front 
of the various quantum channels in the time local quantum 
master equations given by Eq. (|54|) and Eq. (|81|) . so that their 
sign determines P-divisibility and CP-divisibility of the cor- 
responding quantum semi-Markov processes, as discussed in 
Sect.HVU 



Explicit example 



For the case of a memoryless waiting time distribution 
of the form Eq. , so that k (t) is actually a delta 
function and q(t) = exp(—2Xt), according to Eq. ((56)) 
the function 7 (t) is simply given by the positive constant 
A. Each non-Markovianity measure is easily assessed to 
be zero. 

To consider non-trivial situations, non-Markovian in 
the classical case, let us first assume a waiting time dis- 
tribution of the form Eq. (|29|) , arising by convolving two 
exponential memoryless distributions with the same pa- 
rameter. The function q (t) is then given by Eq. pip , so 
that 7 (t) reads 



7 (t) = A 



1 



1 + cotg (At) ' 



(68) 



which indeed takes on both positive and negative values, 
diverging for Xt = (3/4) tt mod tt. Both functions are 
plotted in Fig. 01 In this case the 
exactly determined and is given by 



region 



be 



u 

n6N 



1 / ^ 1 

- (tt + wr) , - 



(69) 



As already observed both measures become nonzero when 
\q (t) \ grows. The measure proposed by Breuer, Laine and 
Piilo according to Eq. (jM)) can now be exactly calculated 
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FIG. 5. (Color online) The same as Fig. [3] but for the convo- 
lution of two different exponential waiting time distributions. 
We plot the quantities as a function of st, taking p/s 2 = 0.12. 
Note that in this case 7 (t) (green dot-dashed line) is always 
positive, while 8 (t) (blue continuous line) is always negative. 
The function q (t) (red dashed line) monotonically decreases 
reaching the value zero only at infinity. 



and is given by 



tt + rm 
A 



/3tt/4 



V A 



'7 - V 



(70) 



which is finite and independent on A. It is to be stressed 
that considering the convolution of a higher number of ex- 
ponential waiting time distributions one obtains a higher 
value for this measure, according to the fact that the 
overall waiting time distribution departs more and more 
from the memoryless exponential case (32j . The measure 
proposed by Rivas, Huclga and Plcnio instead is equal 
to infinity Z(<I>) = 00, due to the fact that q(t) goes 
through zero and therefore 7 (t) diverges. Actually I ($) 
is equal to infinity whenever the inverse time evolution 
mapping fails to exist. It therefore quantifies in the same 
way non-Markovianity for quite different situations, e.g. 
in this case waiting time distributions given by the con- 
volution of a different number of exponentials. 

As a further example we consider a convolution of 
two different exponential distributions, corresponding to 
Eq. |35]) and Eq. ((38)) . so that one now has 



V 



7 (*) = 2^ 



1 



sl + xCoth fx 



(71) 



Recalling Eq. (1371) and Eq. (|39l) the argument of the hy- 
perbolic cotangent is real, so that 7 (t) always stays pos- 
itive, if p ^ s 2 /8. In this case, despite the underlying 
non-Markovian classical process, both measures of non- 
Markovianity are equal to zero. The behavior of q (t) and 
7 (t) for this case is depicted in Fig. [5] When p > s 2 /8, 
which includes the case Ai = A2, q(t) again oscillates 
between positive and negative values, so that one has a 
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FIG. 6. (Color online) The same as Fig. [4] but for a con- 
vex mixture of two different exponential waiting time distri- 
butions. We plot q (red dashed line), 7 (green dot-dashed 
line) and 5 (blue continuous line) as a function of Ai, taking 
Ai = a\X and A2 = «2A, with ai = 1 and £12 = 6, together 
with mixing parameter fi — 0.6. For this kind of waiting 
time distribution all functions always stay positive, quickly 
reaching an asymptotic constant value. 



similar behavior as before, with Af (3?) assuming a finite 
value and X($) = 00. 

Finally let us consider a convex mixture of two mem- 
oryless distributions as given by Eq. (|4T))) , so that q(t) is 
now given by Eq. (1421 and one has 



7(*) = (A>- 



1 



1 (A 1 + A 2 -3(A)KA 1 +A 2 + (A))-A" 
4 A(A> 



Coth 



(*) 



1 



(Ai+A2-3(A)) 
A 



Coth ( % 



(72) 

which according to the definitions of (A) and A given in 
Eq. (|43[) and Eq. (|44| can be checked to always take on 
positive values. Its behavior is given in Fig. [5] In this 
situation both measures are equal to zero. 

C. Dephasing dynamics via projection 

A quantum dynamics corresponding to pure dephasing 
is also obtained considering a CPT map £ which is also 
a projection, that is 

E p p = a+<j-p<7+(T- + <j-o + po-<j + (73) 

so that one has idempotency £ 2 p = £ p . For this case the 
analysis closely follows the one performed for £ z . but the 
crucial quantity instead of q (t) is the survival probability 
g(t), similarly to the classical case with it = 1/2 dealt 
with in Sect. IIII A[ The matrix F is given by 

F(i,0)=diag(l, ff (t),s(t),l) (74) 
and the time-local master equation reads 

±p ( t ) = h (t) (£ + _ [p (t)] + £_ + [p (t)]) , (75) 

with Lindblad operators 

£+- \P] = cr+(J-pcr+(J- 



and similarly for C |_. The quantity h (t) is given by 

/(*) 



h(t) 



9(t) 

"^logffW: 



(77) 



which provides the so called hazard rate function associ- 
ated to the waiting time distribution / (t), given by the 
ratio of waiting time distribution and survival probabil- 
ity. It gives information on the probability for the first 
jump to occur right after time t [39(. Note that the sur- 
vival probability is a positive monotonously decreasing 
function, and the hazard rate function is always positive. 
As a result CP-divisibility always holds, so that both 
non-Markovianity measures are equal to zero, whatever 
the waiting time distribution is. 



D. Dissipative dynamics and time-local equation 

The choice of CPT map considered above, correspond- 
ing to pure dephasing, shows how different probability 
densities for the waiting time, corresponding to differ- 
ent distributions of the action of the quantum operation 
in time, can lead to dynamics whose measures of non- 
Markovianity can be both positive or zero, irrespective 
of the fact that the only memoryless waiting time distri- 
bution is the exponential one. In this case, however, there 
is no direct connection to a classical dynamics, since only 
the coherences evolve in time. Another natural choice of 
CPT map which leads to a non trivial dynamics for the 
populations is given by 



£±P = < J -P (T + + (J +P (J - 



(78) 



which satisfies £± n = £\ and = £±, so that one 

can obtain the explicit representation 

pll (t) = Peven (*) Pll (0) + Podd (*) POQ (0) 

pio (i) = s(t)Pio(0) 
P01 (t) = g(t)p O i(0) 

P00 (t) = Podd (t) Pll (0) + Pcvon (*) POO(0) (79) 

where g(t) denotes as usual the survival probability. As 
in the previous case we can obtain the matrix F repre- 
senting the action of the map with respect to the chosen 
basis of operators in (D 2 , now given by 



F(t,0)=dias(l,g(jt),g(t),q(t)) 



(80) 



W+v-,p} 



(76) 



and accordingly the time-convolutionless master equa- 
tion reads 



-p (t) - 7 (f) (£+ [p (t)} + £- [p (t)]) + 6 (t) C z [p (t)] , 

(81) 

where besides L z as given by Eq. (f5"5"j) the quantum chan- 
nels 

£+ [p] = V+P&- - o { cr - <7 +' P) ( 82 ) 
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and 



(83) 



appear. The time dependent rate 7 (t) is still given by 
Eq. ([551) , while the function <5 (i) is given by the difference 



5(t) = -(h(t)->y(t)), 



(84) 



where h (t) is the so called hazard rate function intro- 
duced in Eq. (|77|) . which is always positive. 



1. Divisibility 

Also in this case we can consider the divisibility prop- 
erties of the time evolution. According to the matrix 
representation of the map, Eq. ([3]) now leads to 



F(i,s) = diag 1, 



g(t) gjt) q(t) 

g(s)' g(s)' q(s) 



(85) 



so that thanks to the property of the survival probabil- 
ity the only condition for P-divisibility is still given by 
Eq. (|58p . Therefore the map is P-divisible whenever 
\q(t)\ is a monotonic decreasing function. Note that this 
condition implies positivity of 7 (t) , and therefore of the 
time dependent rate in front of the £+ and £_ channels, 
which affect the dynamics of the populations. In order 
to study CP-divisibility one has to consider the associ- 
ated Choi matrix, whose positivity is granted upon the 
further condition 



g(t) < 1 
g(s) " 2 



1 



«(*) 



(86) 



which sets a non trivial requirement, implying positivity 
of the function 5 (t) which provides the coefficient of the 
purely quantum channel C z . Thus CP-divisibility is vi- 
olated if and only if at least one of the prefactors in the 
time-local form Eq. ([51]) becomes negative. Note how- 
ever that in this case, due to the presence of different 
quantum channels, P-divisibility and CP-divisibility are 
not necessarily violated together, since it can well hap- 
pen that 7 it) stays positive, but 8 it) takes on negative 
values. As discussed in the examples below and shown 
in Fig. [5j for a suitable choice of waiting time distribu- 
tion one can have a process which is P-divisible, but not 
CP-divisible. 



2. Measures of non-Markovianity 

Also for this model we can obtain the explicit expres- 
sion for the measures of non-Markovianity according to 
11211 and UM ■ The trace distance now reads 



Dip 1 it),p 2 (i)) = ^(t)A p (0) s 



(87) 



where we have used the same notation as in Eq. (|6ip and 
Eq. (p2")l , so that the derivative is 



A p (0) 2 g(t)g(Q-|A c (0)| 2 g jt) f jt) 
yfi? it)A p (0) 2 + |A c (t))|V (*) 



t,p^(0)) 



and can grow in the region Q + where q it) and q it) have 
the same sign. In this region \q{t)\ does increase. The 
growth is maximal for A c (0) = and A p (0) = 1, so that 
the couple of states which maximize it is given by the pro- 
jectors on ground and excited state. As a result, similarly 
as before we have for the measure of non-Markovianity 
introduced by Brcucr, Lainc and Piilo 



A/"($) 



dt-\qit)\ 

n + at 



(89) 



£>(&0|-|9(aOI). 



This result for the choice of CPT map £± is right the 
same as for the CPT map £ z . This measure becomes 
nonzero if and only if P-divisibility is broken. It can be 
shown that this is generally the case for a bistochastic 
map $ in (D 2 . 

The criterion of Rivas, Huelga and Plenio instead as- 
signs to the map a nonzero measure whenever one of the 
coefficients 7 (t) or 8 (t) take on negative values, so that 
CP-divisibility is broken. Since h it) is always positive, 
these two functions can take on negative values only on 
separate time intervals, as can also be seen from Fig. [4] 
The measure is then given by Eq. ()65[) . where according 
to Eq. (|66[) we have g(t) = whenever both 7 (t) and 
8 it) are positive, while q it) = —2j it) whenever 7 (t) is 
negative, and q (t) = —28 it) in the complementary time 
intervals in which 8 it) takes on negative values. Note 
that this measure I ($) can become positive even if the 
measure A/"($) is zero. Indeed the latter measure for 
this dynamics is related to P-divisibility rather than CP- 
divisibility. 



3. Population dynamics 



For the dynamics described by Eq. (|49l) , with the CPT 
map given by £± as in Eq. ([75]). coherences and popula- 
tions decouple, and the populations obey the same equa- 
tion as the transition probabilities of the classical semi- 
Markov processes considered in Sect. Mil for ir = 1 and 
arbitrary waiting time distribution. This is immediately 
seen identifying the two components of the probability 
vector with the populations in excited and ground state. 
Setting P+ it) = (+\p(t) |+) and P_ (t) = (-pit) |-) one 
has in fact from Eq. (|49p with £± the integrodifferential 
rate equations 



A P± ^ = J* drk it r) [P T ir) P ± (r)] 



(90) 
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corresponding to Eq. (fT4|) for 

-1 1 



W(t) 



1 -1 



*(r). 



(91) 



Also in the classical case the integrodiffcrcntial time evo- 
lution equation can be generally recast in time local form 
[ipj . In this case Eq. would then simply correspond 
to the diagonal matrix elements of Eq. (f5TT) . 

The Kolmogorov distance as in Eq. (|4"5)l is given by 



D K {{Pl(t),Pi(t)},{Pl(t) 



P 2 _(t)})=\A p (0)\\q(t)\ 



so that A/"($), being obtained by considering as initial 
states the projections onto ground and excited state, is 
also given by taking the maximum over the possible ini- 
tial classical states of the integral of the derivative uk of 
the Kolmogorov distance in the time intervals in which 
it is positive. Growth of the Kolmogorov distance again 
depends on the behavior of \q (t) \ only, which determines 
whether the map is P-divisible or not. In view of this con- 
nection it appears that one can have non-Markovianity 
measure Af ($) for the quantum map <I> equal to zero 
even if the dynamics for the populations can be related 
to a non-Markovian classical process. Again this is not 
too surprising, since the one-point probabilities cannot 
really keep track of Markovianity or non-Markovianity 
in the classical sense, even though in the non-Markovian 
case they can show up different behaviors than those typ- 
ical of the Markovian one. 



l + £Coth(f£) i 



xCoth(f x ) 



(.93) 



If the ratio A1/A2 is far enough from one 7 (t) given by 
Eq. (fTTj) as discussed above stays always positive, so that 
one has P-divisibility and the measure Af ($) is equal 
to zero. On the contrary the function 8 (t) is negative, 
so that the coefficient in front of the quantum channel 
is always negative and CP-divisibility is violated , thus 
determining a positive measure T(<S>). This situation is 
considered in Fig. [5J 

As a last example we consider a convex mixture of 
exponential distributions, leading to Eq. ([72| as well as 



h(t) 



/iAie 



-Ait 



(1 - n) A 2 e 



-A 2 t 



^e-Ai* _|_ (1 _ e -A 2 * 



(94) 



For this case, independently of the value of the mixing pa- 
rameter /z, one has that both 7 (t) and 8 (t) stay positive. 
A dynamics of this kind for an open quantum system 
is often termed time-dependent Markovian [l6j . since at 
any time the generator is in Lindblad form. Once again 
both measures Af (4>) and I (<E>) give a zero value of non- 
Markovianity, despite the fact that the underlying wait- 
ing time distribution is not memoryless, corresponding 
to a population dynamics described by a classical semi- 
Markov process which is not Markovian. 



4- Explicit examples 

At variance with the case of pure dephasing, the 
two measures of non-Markovianity do not agree for this 
model. The measure Af ($) becomes positive as soon 
as P-divisibility is broken, which depends on the sign of 

7 (t) only, while I ($) becomes positive even when only 
CP-divisibility does not hold, which also depends on the 
sign of the function 8 (t) appearing in front of the purely 
quantum channel C Zl which determines the dynamics of 
the coherences. To consider the behavior of the measures 
for this model we thus have to consider also the quantity 

8 (£), which is simply equal to zero for an exponential 
waiting time distribution, so that in the proper Marko- 
vian case this pure quantum channel is not available. 

For the case of the convolution of two equal exponential 
distributions exploiting Eq. (|2"9"]l and Eq. (|30p together 
with Eq. (|68|) we have 

^Kr^' i+cotg^) )' (92) 

so that both 7 (t) and 8 (£) oscillate in sign and diverge 
when cotg (Ai) takes on the value minus one, as shown 
in Fig. [4] In this case both measures are positive, while 
considering the convolution of two different exponential 
distributions one has thanks to Eq. (|35|) . Eq. (|3"o| and 
Eq. (HED 



V. CONCLUSIONS AND OUTLOOK 

In this paper we have analyzed the notion of non- 
Markovianity for the dynamics of open quantum systems, 
starting from the classical setting and focusing on con- 
crete examples. While knowledge of a non-Markovian 
classical process requires information on all the condi- 
tional probability densities, when studying the dynamics 
of an open system one only considers the evolution of 
the state, expressed by a probability vector in the classi- 
cal case and a statistical operator for a quantum system. 
The notion of non-Markovianity for classical processes 
and for dynamical evolutions are therefore by necessity 
distinct concepts. One is then naturally lead to the ques- 
tion whether and how the non-Markovianity of a process 
reflects itself in the behavior of the one-point probabil- 
ity. It turns out that the notion of P-divisibility, in the 
sense of the existence of well-defined stochastic matrices 
connecting probability vectors at different time points, 
as well as monotonic decrease in time of the Kolmogorov 
distance among states arising from different initial condi- 
tions, are typical features of Markovian processes in the 
classical case. The lack of these properties can thus be 
interpreted as signature- of non-Markovianity, and used 
to quantify it. Note that due to the fact that the classi- 
cal definition of non-Markovianity actually involves all n- 
point probability densities, these signatures as expected 
indeed provide a different notion of non-Markovianity, 
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which only gives a sufficient condition in order to assess 
non-Markovianity in the original sense. This behavior 
is shown by means of example relying on the study of 
certain semi-Markov processes. 

Such signatures of non-Markovianity can be brought 
over to the quantum framework, considering the notion of 
CP-divisibility, corresponding to the fact that the quan- 
tum time evolution map can be arbitrary split into CPT 
maps corresponding to intermediate time intervals, and 
of the trace distance, which is the quantum version of the 
Kolmogorov distance. These two criteria are at the basis 
of two recently introduced measures of non-Markovianity 
for open quantum systems [l2l Il3j , which we here com- 
pare considering a quantum counterpart of classical semi- 
Markov processes. Moreover, analyzing both the inte- 
grodiffcrcntial and the time local form of the equations 
of motion, we show that one can point to possible sig- 
natures of non-Markovianity to be read directly at the 
level of the equation, despite the fact that Markovianity 
or non-Markovianity itself is a feature of the solution. 
In this respect it appears that the time local form of the 
equations, despite isolated singularities, is certainly more 
convenient. 

More specifically, the classes of examples discussed in 
the paper, besides clarifying the relationship between 
the distinct notions of non-Markovianity used for classi- 
cal processes and for dynamical evolutions, allow an ex- 
act evaluation of the measure of non-Markovianity intro- 
duced for quantum dynamical maps, see e.g. the remark- 
able result given by Eq. ((70)) . These physical examples 
further allow an explicit comparison of the two measures 
for whole classes of quantum dynamical maps. In par- 
ticular, as shown by Eq. (|M| and Eq. (p7|) and discussed 
thoroughly in Sect. IIV B 3[ we put into evidence that the 
measure based on CP-divisibility [l3[ gives the same in- 
finite value to quite different time evolutions, at variance 
with the measure based on the dynamics of the trace 
distance [l2[, which assigns to them different weights. 

In this paper we have discussed the different defini- 



tions of non-Markovianity relevant for classical stochas- 
tic processes and dynamical evolutions. The latter are 
based on the divisibility of the time evolution map and 
on the dynamic behavior of the distinguishability among 
different initial states. While these definitions of non- 
Markovianity can be considered both in the classical and 
the quantum case, as discussed in Sect. Mil and Sect. IIVI 
the original definition of non-Markovianity for a classi- 
cal process cannot be transferred as such to the quantum 
realm, because of basic principles of quantum mechanics. 
On the one hand to make statements about the value of 
a certain observables at different times, a measurement 
scheme has to be specified, which affects the subsequent 
time evolution; on the other hand the statistical opera- 
tor of a quantum systems provide different, and generally 
incompatible, classical probability densities for different 
observables, as a typical feature of quantum probabil- 
ity with respect to classical probability jU |42j • In this 
respect one should be satisfied with different definitions 
and measures of non-Markovianity within the classical 
and the quantum framework. 

It is clear that physical systems can provide us with 
much more complicated dynamics than the one consid- 
ered in this paper and the recent literature. However the 
analysis of these situations sheds light on the basic ideas 
used in defining Markovianity or non-Markovianity of a 
time evolution, and to their connection with the classical 
definition of non-Markovian, thus possibly opening the 
way for a more refined and general analysis. 
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